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Abstract 

Our broader goal is to automatically translate English sentences into formulas in ap- 
propriate knowledge representation languages as a step towards understanding and thus 
answering questions with respect to English text. Our focus in this paper is on the lan- 
guage of Answer Set Programming (ASP). Our approach to translate sentences to ASP 
rules is inspired by Montague's use of lambda calculus formulas as meaning of words and 
phrases. With ASP as the target language the meaning of words and phrases are ASP- 
lambda formulas. In an earlier work we illustrated our approach by manually developing 
a dictionary of words and their ASP-lambda formulas. However such an approach is not 
scalable. In this paper our focus is on two algorithms that allow one to construct ASP- 
lambda formulas in an inverse manner. In particular the two algorithms take as input two 
lambda-calculus expressions G and H and compute a lambda-calculus expression F such 
that F with input as G, denoted by F@G, is equal to H; and similarly G@F = H. We 
present correctness and complexity results about these algorithms. To do that we develop 
the notion of typed ASP-lambda calculus theories and their orders and use it in developing 
the completeness results. 

KEYWORDS: Natural Language Understanding, Answer Set Programming, Lambda Cal- 
culus, Inverse Lambda Algorithms 



1 Introduction 

The broader goal of our proposed research is to translate English sentences to 
appropriate knowledge representation (KR) and reasoning languages. This will help 
in understanding text and answering questions with respect to it. Such an ability 
is important in developing various systems that need "understanding of natural 
language" . This includes systems that can acquire knowledge from text, systems 
that can interact in English with robots and other systems, intelligent training 
and tutoring systems, and systems that can process existing scientific literature in 
particular domains and formulate hypothesis. 

Our approach is inspired by Montague's work ( |Montague 1974[ ) where the mean- 
ing of words and phrases are expressed as A-calculus expressions and the meaning 
of a sentence is built from the meaning of its words by making appropriate appli- 
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cations of the corresponding A-calculus expressions. This approach has also been 
used elsewhere, such as in (Blackbu rn and Bo s 2005 ; Zcttlcmoyer and Collins 2005 
IBaral et al. 20081 IDzIfcak et al. 20091 ICostantini and Paolucci 2010|[Baral et al."20i~2"l) ; 
but the question that we address here is how do we obtain the X-calculus like mean- 
ing of words? They get complex quickly and hand crafting them is not scalable. 

In this paper we use ASP as our target KR language and address the issue of 
automatically obtaining meaning of words as ASP- A-calculus formulas instead of 
the underlying logic of first order logic in traditional use of A-calculus. Thus, the 
meanings of words are expressed as formulas of ASP- A-calculus and using them 
sentences are translated to ASP rules. In (jBaral et al. 2008)) the ASP- A-calculus 
formulas that represent words were handcrafted and it was remarked that the hu- 
man engineering needed to generate the ASP- A-calculus expressions need to be 
substituted by an automatic process. 

Our main idea in automating this process is through a a notion of inverse appli- 
cation of ASP-X-calculus formulas and use them in constructing the ASP- A-calculus 
expressions of words. We discuss two algorithms from (jGonzalez 2010j) that com- 
pute a ASP- A-calculus expression^ F given ASP- A-calculus expressions G and H. 
In the first algorithm, which we call the Inverse^ algorithm, the F is such that by 
applying G as an input to it one obtains H; this is written as F@G — H. In the 
second algorithm, which we call the Inverse^, algorithm, F is such that G@F = H. 
We refer to these algorithms as the Inverse A- Algorithms. In this paper we define 
ASP- A-calculus formulas and formalize how this approach can be used to translate 
words into these formulas, yielding a method to automatically translate sentences 
into ASP rules. 

We illustrate the basic idea of inverse application of ASP- A-calculus formulas 
and how they can be used in constructing the ASP- A-calculus expressions of words 
through the following example. 



Most birds fly 

(S/(S\NP))/NP NP S\NP 
S/(S\NP) S\NP 

s — 

Most birds fly 

??? Xx.bird(x) Xx.fiy(x) 



Xx.fly(x) 

fly(X) ~ btrd(X),not^fly(X) 

Table 1. CCG and A-calculus derivation for "Most birds fly". 



It is assumed in Table [T] that the meaning of "Most birds fly" and the ASP-A- 
calculus formulas for "fly" and "birds" is known. We would like to determine the 
appropriate semantic representation for the word "most" . To do so we must first 
compute the semantic representation of "Most birds" . This can be done using the 
meaning of the sentence "Most birds fly" and the word "fly". However, we first 



1 This algorithm a lso works for typed first-order logic lambda calculus. We show that in 
(Baral ct al. 20f2). But its applicability to ASP is not discussed there as that requires ad- 
ditional machinery, which we present in this paper. 
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must know whether the meaning of "Most birds" is to be used as input to the 
meaning of "fly" or vice versa. To obtain this directionality information we make 
use of combinatory categorial grammars (CCG) (Stccdm an 2000[) . 

A CCG parse of a sentence assigns categories to the words of the sentence. There 
are several basic categories, with S representing a sentence and NP representing 
a noun phrase. More complex categories are formed from these basic categories by 
using "\" and "/" which specify directionality. For example, a non-transitive verb, 
like "fly" above, would have category S\NP meaning that if a noun phrase, NP, 
precedes the verb then a sentence S is formed. Similarly, a category for a simple 
adjective, would be NP/NP, meaning that if a noun phrase, NP, comes after the 
adjective then a NP would result. 

Note that the category of "most" given here is not that of a simple adjective, 
NP/NP. If "most" had this category then the result of applying "birds" to "most" 
would result in category NP which would then be applied to the right of "fly". 
However, it is not possible to form the meaning of the sentence by substituting into 
the given meaning of "fly". Therefore, an alternative CCG parse of the sentence 
must be used that swaps the application of "fly" to be on the right side. This is 
done by raising the category of "Most birds" to S/(S\NP), which in turns means 
that the category of "most" must be (S / (S\NP))\NP . 

The top part of Table Q] gives a CCG parse of the sentence "Most birds fly". 
The meaning of the phrase "Most birds", which has a category S / (S\NP), must 
have the meaning of "fly" applied from the right since it has the category S\NP. 
Therefore, to get the meaning of the sentence, H, we let G be the meaning of "fly". 
Then we have to find an F such that F@G — H. From inspection F — Xx.(x@X 
bird(X), not ~^x@X) will satisfy this equation. 

Now, having the expressions for "Most birds" and "birds" , we can calculate the 
meaning of the desired word "most". Since "most" has category (S / (S\NP)) / NP , 
we have to apply the meaning of "birds" to the right of it to obtain the meaning of 
"Most birds". From inspection taking the meaning of "most" to be Xv.\x.(x@X <— 
v@X, not ->x@X) produces the desired result. 

As this example demonstrates, given the meaning of most words in a sentence 
and a CCG parse for the sentence, we can find a new semantic representation 
for words and phrases whose meanings are unknown. The question is how exactly 
do we determine the new representation? In this paper we discuss the Inverse-A 
Algorithms (Gonzalez 2010) to solve this task, which is known as the Inverse-A 
problem, d 

To help in showing the correctness and applicability of our Inverse^ and Inverse^ 
algorithms we extrapolate the notion of typed A first order theories to define the 

2 The Inverse-A problem can be shown to b e a special ca ses of the "higher-order matching" 
(Dowck 1994} and "Interpolation problem" (Stirling 2009) . Specifically, the Inverse^ problem 
corresponds to an Interpolation problem and Inverse^ problem corresponds to the Higher- 
order matching problem. The higher order matching problem is known to be undecidable in the 
general case ( Loader 2003 ) . Higher order matching can be further considered as a special case of 
higher order unification which has been explored in (Huct 1973 Huct 1975} and recently used 
in (Kwiatkowski ct al. 2010). None of these works consider ASP. 
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notion of a typed ASP-X theory. We then define the notion of orders of such theories. 
Using these notions we present the soundness, completeness and complexity results 
of the Inverse-A Algorithms. For example, the completeness result is with respect 
to typed ASP-A-calculus formulas up to the second ordeitJ We then illustrate the 
use of the Inverse-A Algorithms with respect to typed ASP-A-calculus formulas. 

As mentioned earlier, these algorithms are key to developing systems that can 
translate English sentences to KR languages. However, such systems need to address 
additional issues such as dealing with possible multiple meaning of words, and 
developing appropriate ontologies that maximize the accuracy of the translation. 
These aspects are separately discussed in (jDzifcak et a l. 2009). A simpler version 
of the Inverse-A Algorithms discussed in this paper is used in developing a system 
that learns to translate combinatorial puzzles to ASP rules and solve those puzzles 
(jBaral and Dzifcak 20l"2| 

In summary the main contributions of this paper are: 

• We formulate the notion of typed ASP-A-calculus theories and define the 
notion of orders of such theories. 

• We illustrate the use of Inverse-A Algorithms with respect to typed ASP-A- 
calculus formulas. 

• We present soundness, completeness and complexity results for these algo- 
rithms with respect to typed ASP-A-calculus theories. 

The rest of this paper is organized as follows. In the next section, we present some 
background material and pointers on typed lambda calculus and ASP. In Section 
3 we introduce typed Answer Set Programming lambda calculus. In Section 4 we 
present the Inverse A- Algorithms. We then illustrate our algorithms with respect to 
several examples and give a use of our algorithms in sections 5 and 6, respectively. 
In Section 7 we present the soundness, completeness and complexity results. Finally, 
we conclude and briefly mention the companion natural language semantics work 
that uses our algorithms. 

2 Background 

2.1 Typed Lambda Calculus 

Since Montague's groundbreaking work (Montag ue 1974[ ), A-calculus has been ac- 
cepted and used as a tool by many in natural language semantics. Montague was 
the first to introduce the use of A-calculus to represent the meaning of words and 
A- application as a mechanism to construct the meaning of phrases and sentences. 
However, to properly understand the notion of "meaning" (or semantics), it is use- 
ful to consider models of A-calculus expressions. When referring to a model, one is 
looking for a semantic tool that can give it two elements: the entities that are part 

3 Blackburn and Bos say in page 101 of their book (Blackburn and Bos 2005): "Now, arguably 
natural language semantics never requires types much above order three or so-nonetheless the 
ability to take a logical perspective on higher-order types really is useful." Note that their 
definition of order three corresponds to our definition of order 2. 
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of the domain, and for every element in the signature, the semantic value associ- 
ated with it. By creating this model with the corresponding denotations for types, 
expressions of the system will have a defined type and a semantic value associated 
with it. 

Both untyped and typed A-calculus can be characterized using models, but typed 
A-calculus has had the most impact on natural language semantics, which also 
became familiar to linguistics after the mentioned works by Montague. In this paper 
we will follow the Simply Typed Lambda Calculus of Church ([Church 1940[) to have 
ASP as the core logic. This is the most commonly used approach in linguistics 
where only one type constructor is used to build types, "— >" , and each term has a 
single type associated with it (Barendrcgt 1992). 

Because of space constraints, we do not present the typed lambda calculus defi- 
nitions that we use to define typed ASP-A calculus. The books (Hindley 1986) and 
dHindley 1997D are good reference points for typed lambda calculus. 

2.2 Answer Set Programming 

Answer Set Programming is the language of logic programming with answer set se- 
mantics (jGelfond and Lifschitz 19 88 ). This lan guage is one of the most suitable 
declarative languages (Bar al 2003[) for knowledge representation, reasoning and 
declarative problem solving; all important aspects that are needed to develop nat- 
ural language understanding systems. It has a large body of support structure, 
including efficient implementations and theoretical building block studies. It allows 
the representation, in an intuitive way, of various kinds of knowledge that cannot 
be adequately expressed in first-order logic. These include, for instance, default 
statements {most birds fly) and normative statements [normally birds fly). We 
now present some basic definitions related to Answer Set Programming syntax and 
semantics (jBaral 2003p . 

Definition 1 {ASP rule) 
An ASP rule is of the form: 

Lq or ... or L k «- L k+1 , . . . , L m , not L m+1 , . . . not L n - 

where Li are literals and k > 0, m > k and n > m. 

The literals to the left of the " belong to the Head of the rule, and the literals 
to the right of the " belong to the Body of the rule. An ASP program is a set of 
ASP rules. 

Definition 2 {Satisfiability) 
An ASP rule of the form: 

Lq or or L k <- L k+1 , ... , L m , not L m+1 , ... not L n - 

of an ASP program n is said to be satisfied by a set of ground literals I of n if: 
• {L k+ i ,...,L m } C I and {L m+1 L n } n I = implies that {L Q ,...,L k } fl// 
0. 
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Definition 3 

An Answer Set of an ASP Program II without the "not" operator, is a consistent 
set of ground literals S such that S satisfies all rules of II and no subset of S satisfies 
all rules of II . 

Definition 4 (Answer Set) 

A consistent set S of ground literals is an Answer Set of an ASP Program II if S 
is an answer set of the reduct IP , where H is obtained from II by 

(i) Deleting all rules from II that contain some not I in their body for some I E S. 

(ii) Removing all occurrences of not I from the remaining rules. 

3 Typed Answer Set Programming Lambda Calculus 

We start by presenting the signature for the language Typed Answer Set Program- 
ming Lambda Calculus (Typed ASP Lambda Calculus). It consists of the following: 

• the lambda operator, also called abstractor, A; 

• the lambda application @; 

• the parenthesis symbols (,),[, and ]; 

• for every type a, an infinite set of variables u„,a for each natural number n; 

• for every type a, a (possibly empty) set of constants c a of type a; 

• the connectives or , not, "," and and 

• predicate and function symbols. 

Variables and constants in the signature for Typed ASP Lambda Calculus will be 
referred to as X-terms. 

Next, we introduce the set of types that will be used with Typed ASP Lambda 
Calculus, in conjunction with the definition of the semantics of types assigned to 
the different expressions of the language. We will follow the principles presented in 
([Barbara H. Partee and Wall 1990|) . where D a represents the set of possible objects 
(denotations) that describe the meanings of expressions of type a. 

Definition 5 (Types) 

The set of types is defined recursively as follows: 

1. e, a, I, g, d, h, t are types, called base types, and 

2. if A and B are types, then (^4 — > B) is a type. 

Intuitively, e refers to terms, which is either a variable or a constant in ASP, 
or a function symbol with terms as input; a refers to atoms of ASP, which are 
predicate symbols with terms as inpulQ; / refers to literals of ASP which are atoms 
or atoms preceded by the connective g refers to gen-literals which are literals 
or literals preceded by the connective not; d refers to a conjunction of gen-literals, 
where the conjunction is denoted by h refers to a disjunction of literals, where 
the disjunction is denoted by "or"; and t refers to the boolean truth values. More 
formally, 



4 An atom is said to be ground if none of the terms in the atom contain a variable 
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Definition 6 (Type Semantics) 

Given an ASP Program II, the semantics of II is denned using: 

• D e — the set of terms and functions in the language of II; 

• D a = the set of atoms in the language of II; 

• Di = the set of literals; 

• D g = the set of gen-literals; 

• Dh — the set of "or"-connected literals that belong to heads of ASP rules; 

• Dd = the set of "/'-connected gen-literals that belong to bodies of ASP rules; 

• D t = {0, 1}, the set of satisfiability values for an ASP program; and 

• D a ^b — the set of functions from D a to -Dj. 

Expressions of type t denote satisfiability values of ASP programs. An ASP 
program can be true under certain Herbrand interpretations, and false under others. 
(a — > b) denotes functions whose input is in D a and output values are in D^. For 
example, the type (e — > t) corresponds to functions from terms to satisfiability 
values. 

This section continues by introducing the definition for ASP typed term, followed 
by the definition of ASP A-calculus formula: 

Definition 7 (ASP Typed Term) 

The elements which belong to the set A^ of ASP typed terms of type A are induc- 
tively defined as follows: 

1. For each type A, every A-term of type A belongs to Aa- 

2. For any types A and B 

• if a G A a ^b and f3 G A^, then a@f3 G A B 

• if u is a variable of type A and a £ Ab has free occurrences of the variable 
U, then Au.a £ Aa-*b an d the free occurrences of u are now bound to the 
abstractor AuH 

3. If / is a function symbol with arity n, and t\, fe, . . . , t n € A e , then 
f(t l7 t 2 ,...,t n ) G A e . 

4. If p is a predicate symbol with arity n, and t\, fa, . . . , t n G A e , then 
p(h, t 2 ,..., t n ) G A a . 

5. If a G A a and a is not a A-terrrH, then a G A; and (->a) G A;. 

6. If a G A; and a is not a A-term, then a G A g and (not a) G A g . 

7. If a G A; and a is not a A-term, then a G A^. 

8. If a,/3 G A h , then a or /3 G A h . 

9. If a G A s and a is not a A-term, then a G Ad- 

10. If a, G A d , then a, (3 G A d . 

11. If a G Ah and (3 G A d , then (a <— •) G A t , (<- /?•) G A t , and (a <- /?•) G A t . 

12. If p 1( p 2 e At, then (p x p 2 ) G A t . 



5 Refer to the definition of occurrence presented at the end of this section. 

6 This is to guarantee that each A-term only corresponds to its unique type. 
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Definition 8 (Typed ASP X-C'alculus Formula) 

A typed ASP A-calculus formula is an ASP typed term where every variable is 
bound to an abstractor and every abstractor binds to a variable. 

A typed ASP A-calculus formula is in /3-normal form if it does not contain 
any /3-redex occurrences. An example of a /3-redex is a typed term of the form 
(Av.v)@ John. The typed term John or Av.v, do not have any /3-redex occurrences 
dHindley 19971 ). 

The binding of every variable to an abstractor and every abstractor to a variable 
in definition [8] correspond to closed and Al-terms in the classic theory of lambda 
calculus, respectively. These conditions ensure that one obtains Answer Set Pro- 
gramming programs when the typed ASP A-calculus formulas are in /3-normal form. 
By the way in which the ASP typed terms have been defined and the two prop- 
erties that we are enforcing, when there are no lambda abstractors left in an ASP 
typed term we obtain an expression that belongs to the Answer Set Programming 
language presented above. Some examples of typed ASP A-calculus formulas are 
the following: 

• Xw.Xv.(w <— v@X.) with type (h — > ((e — > d) — > £)) where w has type h, v 
has type (e — > d), and X has type e. 

• \x.\y.(<r- h(x), not -i y.) with type (e — > (a — > t)) where x has type e and y 
has type a. 

• Xv.(v or -i v <— ■) with type (a — > t) where v has type a. 

• Xw.(Xu.(w@Xv.(position(v 1 «)))) with type (((e —>?)—» t) — > (e — > t)) where 
w has type ((e — > I) — > £), u and v have type e. 

Let the fourth formula of the examples be J. In J, ra has type ((e — > I) — > t) 
because when an ASP typed formula is applied J, it will be placed in the variable 
w and will receive as argument the expression Xv.(position(v, u)). This expression 
has type (e — > I) and therefore the input of the formula applied to J needs to have 
(e — > I) as input and t as output to lead to an ASP formula. Thus, w has type 
((e — >• I) — > t). u has type e meaning that one expects a term to be placed inside 
the literal position. 

The following are not typed ASP A-calculus formulas: 

1. Xy.Xx.(y or not x@X), where x has type (e — > I) and y have type I. 

2. Xv.Xw.(-i w <— -i not v@X), where w has type a, v has type (e — > I), and X 
has type e. 

The first expression is not a A-calculus formula since x is of type (e — > I) which 
means x@X has type I from r-i above. Then notx@X must have type g from r$. 
However, there is no rule that allows us to combine y, an element of type I, with 
notx@X, an element of type g, with the connective or. 

The second expression violates the rules of a typed ASP A-calculus formulas since 
there is no rule saying that the connective -i can be applied to terms of type g, 
which in this example is the type of not v@X . 

This section concludes with two more definitions. 



Typed Answer Set Programming and Inverse Lambda Algorithms 



9 



Definition 9 {Occurrence) 

The relation P occurs in Q is denned by induction on Q as follows: 

• an ASP typed term P occurs in P. 

• if P occurs in M or in N, then P occurs in M@N. 

• if P occurs in M, then P occurs in Xx ■ M. 

• if P occurs in or P occurs in ip, then P occurs in <f> or tp, <j) ip and <f> , ip. 

• if P occurs in <p, then P occurs in -i<f> and not 4>. 

• if P occurs in any term U, then P occurs m F(ti,..., t n ). Where F is a function 
symbol. 

• if P occurs in any term ti, then P occurs in R(ti,..., t n ). Where R is a predicate 
symbol of an atom. 

Definition 10 [sub-term] 

A sub-term of a typed ASP A-calculus formula F is any term P that occurs in F. 

3.1 Type Order 

We have introduced the types that will be assigned to typed ASP lambda calcu- 
lus terms and formulas. Next, we present the notion of order, which is associated 
with types and establishes a hierarchical structure that separates typed A-calculus 
formulas to several classes. Order will be an important concept when we state the 
completeness proof for the Inverse A-Algorithms since we will show that they are 
complete for typed A-calculus formulas up to order two. Each typed term has a 
type, and each type will be assigned an order. 

Definition 11 (Type Order) 

The order of a type is defined as: 

1. Base types have order 0. 

2. For function types, order(a — > b) = max(order(a) + 1, order(b)). 

The definition from ( |Stirling 2009[ ) gives order one to base types. In our case, we 
consider order zero for base types since this is the common approach in linguistics. 
Next, some examples of typed ASP lambda calculus formulas with different orders 
are presented: 

• Order zero: bird(tweety)- - type t. 

• Order one: \v.\u.(v u-) - type (h — > (d — » t)). 

• Order two: Xv.Xu.(v@X <- u@X-) - type ((e -> I) -> ((e -> g) -> t)). 

• Order three: Xw.(w@(Xz.h(z))-) - type (((e -> /) ->• t) -> t). 

With these simple examples, one can see the intuition behind the order of typed 
ASP lambda calculus formulas. Formulas of order zero correspond to expressions 
with base types. Formulas of order one correspond to expressions which start with 
a series of lambda abstractors followed by an ASP program with variables bound 
to the initial lambda abstractors. 
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Formulas of order two extend the expressions allowed in order one by including 
applications. Formulas of order zero can be applied to variables inside the formula. 
Formulas of order three extend those present in order two by allowing lambda 
abstractors inside the expression after the initial lambda abstractors. In this case, 
formulas of order one can be applied to variables, this is why now, we can find 
lambda abstractors at the beginning and in the middle of the formulas. These 
claims can be easily proved by contradiction using the given definitions. 



4 The Inverse Lambda Operators 

This section presents the formal definition of the two components of the Inverse A- 
Algorithms, Inverse^ and Inverse^, from ( Gonzale z 2010|) . The objective of Inverse^ 
and Inverseu is that, given typed A-calculus formulas H and G, the formula F is 
computed such that F@G — H and G@F = H, respectively. We now define the 
different symbols used in the algorithm and their meaning: 

• Let G, H and J represent typed A-calculus formulas, J 1 , J 2 ,..., J™ represent 
typed terms; v, w and v\,...,v n represent variables. 

• Typed terms that are sub-terms of a typed term J 1 are denoted as J].. 

We also consider the following two statements: 

• A list of A- abstractors of the form Aui,..., Vi can be empty if the corresponding 
variables Ui,..., Uj are not present in the formula they belong to. 

• If the formulas being processed within the algorithm do not satisfy any of the 
if conditions then the algorithm returns null. 



Definition 12 ( Operator :) 

Consider two lists (of same length) of typed ASP A-calculus formulas Ai,...,A n 
and Bi,..., S„, and a typed ASP A-calculus formula H . The result of the operation 
H(Ai,..., A n : Si,..., S„) is defined as: 

1. find the first occurrence of formulas Ax,..., A n in H . 

2. replace each Ai by the corresponding Bi. 

3. find the next occurrence of formulas Ax,...,A n in H and go to 2. Otherwise, 
stop. 

We now give the two inverse algorithms. 

Definition 13 (Jnverseh[B , G)) 

The algorithm Inverser,(H , G), is defined as: 

Given G and H: 

1. If G is Xv.v 

• then F = Xv.(v@H) 

2. If G is a sub-term of H 

• then F = Xv.H(G : v) 
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3. If G is notXv.v, (J 1 ^,..., J^), J 2 (J?, ... , J* ), ... , /"(J™,..., J™)) are 
sub-terms of H , andVJ 1 £ H , G is Xvi,...,v s ■ J % (J£,..., : Ufe iv .., u^iD 
wii/i 1 < s < m and Vp, 1 < k p < s. 

• i/ien F = Xw.HdJ 1 : (wOJ^®...®/^),..., J n : (>@J£@ ... @J fc ™ ))) 
where each Ju maps to a different v kp in G. 

4. If H is A«i,..., • J and J 1 (J i 1 +1 , ... , J}) is a sub-term of J, 

G is Aw.J(J 1 (J i 1 +1 ,..., J I) : w@j£ 1 @..MJl) with Vp, i + l < k p < s. 

• then F = Xw.Xvi,..., v t ■ (w@Xv i+1 ,... 1 v s ■ (J 1 ( J/ +1 ,..., J* : Ufc lv .., v ks ))) 

Definition 14 (Inverseu(H , G)) 

The algorithm Inversen(H , G), is defined as: 

Given G and iJ: 

1. J/ G is Xv.v@J 

• then F — Inversei(H , J) 

2. If J is a sub-term of H and G is Xv.H(J : v) 

• then F = J 

3. If G is not Xv.v@J , (J 1 (Ji,..., J} n ), J 2 (J 1 2 ,..., J^J, ... , J n ( Jf,..., J")) are 
sub-terms of H and G is Aw.77((J 1 (J 1 1 ,..., J 1 ,) : w@ J fc \@...@ J^),..., (J n (Jf\ 
... , J") : w@J fc ™@ ■ • ■ @J^ m )) uw'fli 1 < s < m and Mp, 1 < fc p "< m. 

• i/ien F = A«i,..., u s . J x ( Jf 1 ,..., : v kl %„)■ 

4. // 77 is Xvi,...,Vi.J and J 1 ( J/ +1 ,..., J s ) is a sub-term of J , 

G is Xw.Xvi,...,Vi.(w@Xv i+ i,...,v s ■ ( J 1 (J/ +1 ,..., J,, 1 : w fcl «*,))) with Vp, 
i + 1 < k p < s. 

• i/ien F - Xw ■ J(J 1 (J?^ 1 ,..., J, 1 ) : 

Please note that the final cases for both operators involve formulas of third order. 

5 Inverse Lambda Algorithm Examples with Typed ASP Lambda 

Calculus 

This section presents several examples demonstrating how the Inverse-A Algorithms 
can be applied to find F in various settings given ASP-A-calculus formulas G and 
H . A use case example follows in the next section. 

5.1 Example 1 

Let H and G be typed ASP A-calculus formulas where H = bird(tweety). and G = 
Xx.x. F needs to be calculated such that H — F @ G. Here case 1 of Inverse^ will be 
applicable. Then F — Xv.(v @ H) and in this case F = Xv.(v @ bird(tweety)). Then, 
F @ G = Xv.(v @ bird(tweety)) @ Xx.x = (Xx.x @ bird(tweety)) = bird(tweety) = 
H. 

7 When the formula G is being generated, the indexes of the abstractors Xvi,...,v s must be 
assigned to bind the variables from % v^ m in such a way that G is a valid formula. 
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5.2 Example 2 

Let H and G be typed ASP A-calculus formulas where H — Xu.(fly(X) <— u, not 
->fly(X).) and G = fly(X). F needs to be calculated such that H = F @ G. Here 
case 2 of InverseL is applicable. Thus, we get F — Xv.H(G : v) = Xv.H(fly(X) : 
v) = Xv.Xu.(v «— u, not -iv.) 

5.3 Example 3 

Let H and G be typed ASP A-calculus formulas with H = Xu.(bird(tweety), 
animal (tweety), penguin(rocky) , animal (rocky), eats(tweety, u)) and G = Xv.Xw.(v, 
animal (w)). F now needs to be calculated such that H = F @ G. Therefore, case 
3 of InverseL will be applicable. 

G is not Xv.v so the first condition is satisfied. From H , one has the following 
formulas that are subterms: J 1 = bird(tweety), animal (tweety) with sub-subterms 
J* = bird(tweety) and J 2 = tweety (from animal (tweety)); J 2 = penguin (rocky), 
animal(rocky) with sub-subterms J-j 2 = penguin(rocky) and J| = rocky (from 
animal (rocky)). Therefore the second condition of case 2 is satisfied. 

The third condition is satisfied since, MJ l G H: G = Xv\.Xv2-J l (J[, J 2 * : u i> v i) 
for % = 1,2. For example, for J 1 , G = Xvi.Xv 2 .J 1 (bird(tweety), tweety : v\, v 2 ) = 
Xv.Xw.(v, animal(w)). 

Therefore one can now calculate that F = Xw.H^J 1 : w @ J/ @ J 2 r ), (J 2 : w @ J 2 
@ J 2 )) = Xx.H^J 1 : x @ bird(tweety) @ tweety), (J 2 : x @ penguin(rocky) @ rocky)) 
= Xx.Xu.(x @ bird(tweety) @ tweety, x @ penguin(rocky) @ rocky, eats(tweety, uj). 

5-4 Example 4 

Let H and G be typed ASP A-calculus formulas with H = love(Mia, Jon) <— 
love(Jon, Mia), and G = Xw.w @ Mia @ Jon <- w @ Jon @ Mia. F needs to be 
calculated such that H = G @ F . Case 3 of Inverse^ will be applied. 

G is clearly not Xv.v @ J. H has the following subterms: J x (Ji, ■ ■ ., J„) = 
love(Mia, Jon) with sub-subterms = Mia and j\ = Jon; J 2 (J 2 , ■ ■ ., J„) = 
love(Jon, Mia) with = Jon and Jf = Mia. Then, G =Xw.H((J x (j\, J%) : w @ 
Jl @ J 2 r ), (J 2 (J?, J£) : w @ J 2 @ J 2 )) = Xw.(love(Mia, Jon) : w @ Mia @ Jon) 
(love(Jon, Mia) : w @ Jon @ Mia). = Xw.w @ Mia @ Jon -s- w @ Jon @ Mia. 
Therefore, G satisfies the second condition of case 3. 

Thus, we calculate F —Xvi.Xv 2 .J 1 (J^, J\ : v\, v 2 ) = Xv\.Xv 2 .(love(Mia, Jon : 
vi, v 2 )) — Xv 1 .Xv 2 .love(v 1 , v 2 ). 

5.5 Example 5 

Let H and G be typed ASP A-calculus formulas where H = Xv .(stay -at(roomb) 
not goto-from(v, room5).) and G = Xw.Xv.(w @ Xu.goto_from(v, uj). F needs to 
be calculated such that H — G @ F. Therefore, case 4 of Inverse^ will be applied. 

H = Xv.J with J = stay-at(room5) not goto_from(v, room5). /(<7; + i, . . ., a s ) 
= goto-from(v, room5) with s — 2 and o 2 = room5. Relabeling the variables of G 



Typed Answer Set Programming and Inverse Lambda Algorithms 



13 



to better match the conditions of the case by substituting v\ for v and V2 for u, we 
see G = Xw.Xvi.(w @ Xv2-{f(cr2 : ^2)))- Therefore, G satisfies the second condition 
of case 4. 

Thus, we calculate F — \w.J{f{<J2) ■ w @ 02) = \w .{stay -at(room§) <— not w 
@ roomb.) 



6 Use Case Examples 

In this section we present a use case of our inverse lambda algorithms to show 
how meaning of words are computed when one knows meaning of the sentences 
and meaning of some of the words. We consider the following sentences from 
(jBaral et al. 2008|) . 

• Most birds fly. 

• Penguins are birds. 

• Penguins do not fly. 

We will consider an initial lexicon that has the semantics for simple nouns and 
verbs. Combinatory Categorial Grammar (CCG) (Cla rk and Curran 2007[) is used 
to construct the meaning of a sentence from the meaning of its constituent words 
and phrases. After parsing the first two sentences using CCG and adding the se- 
mantics from the initial lexicon, we obtain the output of a simplified CCG parsing 
with two categories "S" (sentence) and "NP" (noun phrase) , as shown in Table [2] 



Most birds fly 

(S/(S\NP))/NP NP S\NP 



NP (S\NP)/NP 
NP S\NP 



Penguins 
Xx .penguin (x) 
\x .pengu in { j ) 



fly 

\x.fly{x) 

Xx.fly(x) 

fty(X) bird{X), not^fly(X) 



in 1. 1 ■■■■ in {X ) < — bird {X ) 



Table 2. CCG and A-calculus derivation for "Most birds fly" and "Penguins are 
birds". 

In Table [2] one can see that the semantic representations for the words "most" 
and "are" are missing. We already discussed how we can obtain the semantic rep- 
resentation of "most" before. Now we will illustrate how we can compute it using 
the presented Inverse A-Algorithms. Starting with the first sentence, one can take 
the meaning of the sentence and the meaning of the word "fly" to calculate the 
representation of "Most birds" . 

"Most birds" has category S/(S\NP) and the category of "fly" is being applied 
from its right. Therefore, if we take H as the meaning of the sentence and G 
as the meaning of "fly", we can use InverseL{H , G) to obtain the expression for 
"Most birds". In this case, option three of the algorithm is satisfied and F = 
Xx.(x@X <- bird(X), not -.x@X). 
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Now, we have the expression for "Most birds" and "birds" . Since the word "birds" 
is being applied to the right of "Most birds", we need to again call InverseL[H , G) 
to obtain the representation for "Most". Option three of the algorithm is again 
satisfied and one obtains F as Xv.Xx.(x@X <— v@X, not ~^x@X). This is the 
Typed ASP A-calculus representation for the word "most" . 

The process to obtain the word "are" from the second sentence is very similar. 
First one calls Inversej,[H , G) with H being the meaning of the sentence and G 
being "Penguins" to obtain the meaning of "are birds" . Option three of the algo- 
rithm is satisfied and F = \x.(x@X <— bird(X)). Next, one calls Inversej,[II , G) 
with "are birds" and "birds" to obtain the desired meaning of "are" . Option three 
of the algorithm is satisfied again and F = Xv.Xx.(x@X <— v@X). This expression 
corresponds to the Typed ASP A-calculus formula for the word "are". Next, the 
last sentence is presented in Table [3] 



Penguins do not fly 
NP (S / (S\NP))\NP S\NP 
(i 1 / (i'\A/>>)) F\TW 

s 

Penguins do not fly 

\x .pr'nguin(x) ??? Ax.fly(x) 

77? ~ Xx.flyjx) 

—•jiy(X) < — penguin {X ) 



Table 3. CCG and A-calculus derivations for "Penguins do swim" and "Penguins 
do not fly" . 



In this case, the semantics of the phrase "do not" is missing. This phrase was 
not part of the initial lexicon. For this sentence, we call InverseL first, obtaining 
Xx.[^x@X <— penguin(X)) as the meaning of "Penguins do not", and InverseL 
afterwards to obtain the representation for "do not", which is Xu.Xx.[^x@X <— 
u@X). 



7 Correctness and Complexity of the Inverse Algorithms 

Theorem 1 [Soundness of Inverse^) 

Given two typed A-calculus formulas H and G in /3-normal form, if Inversej,(H , G) 
returns a non-null value F, then H = F @ G. 

Theorem 2 [Soundness Inverse^) 

Given two typed A-calculus formulas H and G in /3-normal form, if Inversen[H , G) 
returns a non-null value F, then H = G @ F. 

Theorem 3 [Completeness of Inverse l) 

For any two typed A-calculus formulas H and G in /3-normal form, where H is 
of order two or less, and G is of order one or less, if there exists a set of typed 
A-calculus formulas O^ of order two or less in /3-normal form, such that VFj 6 9f, 
H = Fi@G, then InverseL[H , G) will give an F where F G 0_f. 
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Theorem 4 (Completeness of Inverse r) 

For any two typed A-calculus formulas H and G of order two or less in /3-normal 
form, if there exists a set of typed A-calculus formulas @f of order one or less in 
/3-normal form, such that VFj G Qf, H — G@F i} then Inversen(H , G) will give an 
F, where F E Op. 

Theorem 5 {Inverse^ complexity) 

The Inverse^ Algorithm runs in exponential time in the number of variables in G 
and polynomial time in the size of the formulas H and G. 

Theorem 6 (Inverse^ complexity) 

The Inverse^ Algorithm runs in exponential time in the number of variables in G 
and polynomial time in the size of the formulas H and G. 

Due to lack of space, we will only comment on how the soundness and complete- 
ness proofs are structured. The complete proofs are given in the online appendix 
of the paper. The soundness proof shows how in each of the four cases of Inverse^, 
the typed ASP A-calculus formula H is obtained by applying F to G. The appli- 
cation F@G is computed using the expressions from the algorithm for F and G, 
generating the expression for H given in the algorithm. The proof of Theorem 1 is 
given in the online appendix of the paper, pp. 2-3. The same reasoning is followed 
for Inverse^. The complete proof of Theorem 2 is given in the online appendix of 
the paper, pp. 3-4. 

The completeness proof is divided to six cases, which correspond to the six pos- 
sible valid combinations of orders that H , F and G may have, such that the order 
of the terms will be less than 2. These are shown in Table 4. For each case, it 
is proven by contradiction that Inverse^ and Inverse^ return a formula F if one 
such F exists. It is done by assuming that they return a null value and reaching a 
contradiction at the end of the proof. In the process, each of the four conditions of 
the algorithms are analyzed, where it is shown that at least one of the conditions 
of the algorithm has be satisfied for each of the six cases. The complete proof of 
Theorem 3 is given in the online appendix of the paper, pp. 4-7 and Theorem 4 is 
given in pp. 7-11. 

Finally, the proof for the complexity results, Theorem 5 and Theorem 6, are given 
in the online appendix of the paper, pp. 11-12. 



H F G | ASP type examples for formula F 




1 
2 

1 
2 



1 
1 

2 
2 
2 
2 







1 
1 
1 



(h ->■ t) -> * 
(I-tf) -> (e-»t) 

-»■ ((e -)■*)-►*) 



e — > t 
a — > (e — ► t) 
d ->■ ((g -> t) t) 



Table 4. Possible order combinations for F, G and H formulas, with H = F@G. 
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8 Conclusion 

In this paper we developed the language of typed answer set programming lambda 
calculus and defined associated notions such as ASP typed term, ASP A-calculus 
formulas, and type orders. We used these notions to formulate soundness and com- 
pleteness of Inverse A- Algorithms with respect to typed answer set programming 
lambda calculus. These algorithms are important in that they allow automatic con- 
struction of ASP-lambda representations of new words using information already 
available about known sentences and words. They have been used in a system that 
is able to learns to translate combinatorial logic puzzle descriptions to ASP rules 
(Baral and Dzifcak 2012) that obtain solutions to the puzzles; however that (short) 
paper does not go into the details of the algorithm, as we do here. 
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